Visuo-haptic object perception for robots: an overview

نویسندگان

چکیده

The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements the technologies for artificial vision touch, effective integration these two sensory modalities robotic applications still needs be improved, several open challenges exist. Taking inspiration from how combine visual haptic perceive properties drive execution manual tasks, article summarises current state art visuo-haptic Firstly, biological basis human multimodal is outlined. Then, latest advances sensing data collection strategies robots discussed. Next, an overview main computational techniques presented, highlighting machine learning presenting few representative articles areas recognition, peripersonal space representation manipulation. Finally, informed by challenges, outlines promising new research directions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Probabilistic Classification of Grasping Behaviours Using Visuo-Haptic Perception

This paper presents a novel approach to visuo-haptic perception of grasping/manipulative tasks. The proposed approach is founded on a hierarchical Bayesian model which integrates the visual information with the haptic data to reach a reasonable percept of what is happening in grasping tasks. The primary goal of the approach is to identify what type of grasping behaviour is being performed by th...

متن کامل

Visuo-haptic multisensory object recognition, categorization, and representation

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recogniti...

متن کامل

Short-term plasticity of visuo-haptic object recognition

Functional magnetic resonance imaging (fMRI) studies have provided ample evidence for the involvement of the lateral occipital cortex (LO), fusiform gyrus (FG), and intraparietal sulcus (IPS) in visuo-haptic object integration. Here we applied 30 min of sham (non-effective) or real offline 1 Hz repetitive transcranial magnetic stimulation (rTMS) to perturb neural processing in left LO immediate...

متن کامل

Haptic Exploration for Navigation Tasks using a Visuo-Haptic Sensor

A system is presented for the haptic exploration of objects in a household environment. Haptic properties are acquired using a passive, deformable sensor tip mounted on a platform. The sensor deformation is measured visually, allowing for a flexible and low-cost design. Navigation of simple robots, such as vacuum cleaners, is improved by active manipulation. Simple service robots for households...

متن کامل

Correcting for Visuo-Haptic Biases in 3D Haptic Guidance

Visuo-haptic biases are observed when bringing your unseen hand to a visual target. The biases are different between, but consistent within participants. We investigated the usefulness of adjusting haptic guidance to these user-specific biases in aligning haptic and visual perception. By adjusting haptic guidance according to the biases, we aimed to reduce the conflict between the modalities. W...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Autonomous Robots

سال: 2023

ISSN: ['0929-5593', '1573-7527']

DOI: https://doi.org/10.1007/s10514-023-10091-y